Far-field electric potentials provide access to the output from the spinal cord from wrist-mounted sensors

OBJECTIVE: Neural interfaces need to become more unobtrusive and socially acceptable to appeal to general consumers outside rehabilitation settings. APPROACH: We developed a non-invasive neural interface that provides access to spinal motor neuron activities from the wrist, which is the preferred location for a wearable. The interface decodes far-field potentials present at the tendon endings of the forearm muscles using blind source separation. First, we evaluated the reliability of the interface to detect motor neuron firings based on far-field potentials, and thereafter we used the decoded motor neuron activity for the prediction of finger contractions in offline and real-time conditions. MAIN RESULTS: The results showed that motor neuron activity decoded from the far-field potentials at the wrist accurately predicted individual and combined finger commands and therefore allowed for highly accurate real-time task classification. SIGNIFICANCE: These findings demonstrate the feasibility of a non-invasive, neural interface at the wrist for precise real-time control based on the output of the spinal cord

The control and training of single motor units in isometric tasks are constrained by a common input signal

Recent developments in neural interfaces enable the real-time and non-invasive tracking of motor neuron spiking activity. Such novel interfaces could provide a promising basis for human motor augmentation by extracting potentially high-dimensional control signals directly from the human nervous system. However, it is unclear how flexibly humans can control the activity of individual motor neurons to effectively increase the number of degrees of freedom available to coordinate multiple effectors simultaneously. Here, we provided human subjects (N = 7) with real-time feedback on the discharge patterns of pairs of motor units (MUs) innervating a single muscle (tibialis anterior) and encouraged them to independently control the MUs by tracking targets in a 2D space. Subjects learned control strategies to achieve the target-tracking task for various combinations of MUs. These strategies rarely corresponded to a volitional control of independent input signals to individual MUs during the onset of neural activity. Conversely, MU activation was consistent with a common input to the MU pair, while individual activation of the MUs in the pair was predominantly achieved by alterations in de-recruitment order that could be explained by history-dependent changes in motor neuron excitability. These results suggest that flexible MU recruitment based on independent synaptic inputs to single MUs is unlikely, although de-recruitment might reflect varying inputs or modulations in the neuron’s intrinsic excitability

High performance wearable ultrasound as a human-machine interface for wrist and hand kinematic tracking

Objective: Non-invasive human machine interfaces (HMIs) have high potential in medical, entertainment, and industrial applications. Traditionally, surface electromyography (sEMG) has been used to track muscular activity and infer motor intention. Ultrasound (US) has received increasing attention as an alternative to sEMG-based HMIs. Here, we developed a portable US armband system with 24 channels and a multiple receiver approach, and compared it with existing sEMG- and US-based HMIs on movement intention decoding. Methods: US and motion capture data was recorded while participants performed wrist and hand movements of four degrees of freedom (DoFs) and their combinations. A linear regression model was used to offline predict hand kinematics from the US (or sEMG, for comparison) features. The method was further validated in real-time for a 3-DoF target reaching task. Results: In the offline analysis, the wearable US system achieved an average R2 of 0.94 in the prediction of four DoFs of the wrist and hand while sEMG reached a performance of R2=0.06 . In online control, the participants achieved an average 93% completion rate of the targets. Conclusion: When tailored for HMIs, the proposed US A-mode system and processing pipeline can successfully regress hand kinematics both in offline and online settings with performances comparable or superior to previously published interfaces. Significance: Wearable US technology may provide a new generation of HMIs that use muscular deformation to estimate limb movements. The wearable US system allowed for robust proportional and simultaneous control over multiple DoFs in both offline and online settings

Online tracking of the phase difference between neural drives to antagonist muscle pairs in essential tremor patients

Transcutaneous electrical stimulation has been applied in tremor suppression applications. Out-of-phase stimulation strategies applied above or below motor threshold result in a significant attenuation of pathological tremor. For stimulation to be properly timed, the varying phase relationship between agonist-antagonist muscle activity during tremor needs to be accurately estimated in real-time. Here we propose an online tremor phase and frequency tracking technique for the customized control of electrical stimulation, based on a phase-locked loop (PLL) system applied to the estimated neural drive to muscles. Surface electromyography signals were recorded from the wrist extensor and flexor muscle groups of 13 essential tremor patients during postural tremor. The EMG signals were pre-processed and decomposed online and offline via the convolution kernel compensation algorithm to discriminate motor unit spike trains. The summation of motor unit spike trains detected for each muscle was bandpass filtered between 3 to 10 Hz to isolate the tremor related components of the neural drive to muscles. The estimated tremorogenic neural drive was used as input to a PLL that tracked the phase differences between the two muscle groups. The online estimated phase difference was compared with the phase calculated offline using a Hilbert Transform as a ground truth. The results showed a rate of agreement of 0.88 ± 0.22 between offline and online EMG decomposition. The PLL tracked the phase difference of tremor signals in real-time with an average correlation of 0.86 ± 0.16 with the ground truth (average error of 6.40° ± 3.49°). Finally, the online decomposition and phase estimation components were integrated with an electrical stimulator and applied in closed-loop on one patient, to representatively demonstrate the working principle of the full tremor suppression system. The results of this study support the feasibility of real-time estimation of the phase of tremorogenic neural drive to muscles, providing a methodology for future tremor-suppression neuroprostheses

Principles of human movement augmentation and the challenges in making it a reality

Augmenting the body with artificial limbs controlled concurrently to one's natural limbs has long appeared in science fiction, but recent technological and neuroscientific advances have begun to make this possible. By allowing individuals to achieve otherwise impossible actions, movement augmentation could revolutionize medical and industrial applications and profoundly change the way humans interact with the environment. Here, we construct a movement augmentation taxonomy through what is augmented and how it is achieved. With this framework, we analyze augmentation that extends the number of degrees-of-freedom, discuss critical features of effective augmentation such as physiological control signals, sensory feedback and learning as well as application scenarios, and propose a vision for the field

Deep learning for robust decomposition of high-density surface EMG signals

Blind source separation (BSS) algorithms, such as gradient convolution kernel compensation (gCKC), can efficiently and accurately decompose high-density surface electromyography (HD-sEMG) signals into constituent motor unit (MU) action potential trains. Once the separation matrix is blindly estimated on a signal interval, it is also possible to apply the same matrix to subsequent signal segments. Nonetheless, the trained separation matrices are sub-optimal in noisy conditions and require that incoming data undergo computationally expensive whitening. One unexplored alternative is to instead use the paired HD-sEMG signal and BSS output to train a model to predict MU activations within a supervised learning framework. A gated recurrent unit (GRU) network was trained to decompose both simulated and experimental unwhitened HD-sEMG signal using the output of the gCKC algorithm. The results on the experimental data were validated by comparison with the decomposition of concurrently recorded intramuscular EMG signals. The GRU network outperformed gCKC at low signal-to-noise ratios, proving superior performance in generalising to new data. Using 12 seconds of experimental data per recording, the GRU performed similarly to gCKC, at rates of agreement of 92.5% (84.5%-97.5%) and 94.9% (88.8%-100.0%) respectively for GRU and gCKC against matched intramuscular sources

Control of spinal motoneurons by feedback from a non-invasive real-time interface

Interfacing with human neural cells during natural tasks provides the means for investigating the working principles of the central nervous system and for developing human-machine interaction technologies. Here we present a computationally efficient non-invasive, real-time interface based on the decoding of the activity of spinal motoneurons from wearable high-density electromyogram (EMG) sensors. We validate this interface by comparing its decoding results with those obtained with invasive EMG sensors and offline decoding, as reference. Moreover, we test the interface in a series of studies involving real-time feedback on the behavior of a relatively large number of decoded motoneurons. The results on accuracy, intuitiveness, and stability of control demonstrate the possibility of establishing a direct non-invasive interface with the human spinal cord without the need for extensive training. Moreover, in a control task, we show that the accuracy in control of the proposed neural interface may approach that of the natural control of force. These results are the first that demonstrate the feasibility and validity of a non-invasive direct neural interface with the spinal cord, with wearable systems and matching the neural information flow of natural movements

A real-time surface EMG decomposition system for non-invasive human-machine interfaces

Real-time surface EMG decomposition, to extract neural activity of spinal motor neurons, provides a non-invasive solution for establishing direct interfaces with the central nervous system. In this paper, we present a real-time EMG decomposition system, validate it through both synthetic and experimental high-density surface EMG (HD-sEMG) data, and demonstrate the system in an upper-limb prosthetic control scenario. The proposed system achieves (in real-time) median decomposition accuracy comparable to offline methods (within 0.5 %) with minimal utilisation of computational resources (x20 faster compared to the literature)

Accurate identification of motoneuron discharges from ultrasound images across the full muscle cross-section

Objective: Non-invasive identification of motoneuron (MN) activity commonly uses electromyography (EMG). However, surface EMG (sEMG) detects only superficial sources, at less than approximately 10-mm depth. Intramuscular EMG can detect deep sources, but it is limited to sources within a few mm of the detection site. Conversely, ultrasound (US) images have high spatial resolution across the whole muscle cross-section. The activity of MNs can be extracted from US images due to the movements that MN activation generates in the innervated muscle fibers. Current US-based decomposition methods can accurately identify the location and average twitch induced by MN activity. However, they cannot accurately detect MN discharge times. Methods: Here, we present a method based on the convolutive blind source separation of US images to estimate MN discharge times with high accuracy. The method was validated across 10 participants using concomitant sEMG decomposition as the ground truth. Results: 140 unique MN spike trains were identified from US images, with a rate of agreement (RoA) with sEMG decomposition of 87.4 ± 10.3 %. Over 50% of these MN spike trains had a RoA greater than 90%. Furthermore, with US, we identified additional MUs well beyond the sEMG detection volume, at up to >30 mm below the skin. Conclusion: The proposed method can identify discharges of MNs innervating muscle fibers in a large range of depths within the muscle from US images. Significance: The proposed methodology can non-invasively interface with the outer layers of the central nervous system innervating muscles across the full cross-section